Adobe expands generative AI offerings with Firefly App

Adobe introduced two versions of the Firefly generative AI app: — Firefly Standard and Firefly Pro — that give customers access to premium Firefly video and audio features. All Firefly plans include unlimited access to Firefly imaging and vector features and tiered capacity for premium video and audio features so customers can choose the right capacity for their generative AI needs. Adobe Firefly’s breadth of capabilities allow users to generate images, edit the images, turn them into videos and apply cinematic movement before moving to Adobe Creative Cloud applications to transition seamlessly from ideation to production.

Generate Video (beta), powered by the Firefly Video Model, empowers creative professionals with tools to generate video clips from a text prompt or image, use camera angles to control shots, create professional-quality images from 3D sketches, craft atmospheric elements and develop custom motion design elements. It supports 1080p resolution to start, with both a lower resolution ideation model for high-speed iteration and a 4K model for pro-level production work coming soon.

“Firefly is designed for creative professionals looking for unmatched creative control and IP-friendly tools that can be used safely and effectively in both ideation and production,” said David Wadhwani, president of Adobe’s digital media business. “We’ve been thrilled to hear from beta customers who’ve found it a game-changer for ideating concepts and producing stunning videos, and we can’t wait to see how the creative community uses it to bring their stories to the world.”

Adobe claims the Firefly application offers a suite of professional-grade controls, enabling creative professionals to deliver their finest work from ideation to production. They can now create 3D worlds, start with style and structure reference images, use professional camera angles to get the perfect shot, and translate audio and video into multiple languages while maintaining an authentic voice, all with Firefly. It integrates with Adobe Creative Cloud applications including Photoshop, Premiere Pro, Express and more — and Firefly is safe for commercial use, providing creators confidence to use it for production-ready content.

New and available globally in the Firefly app today:

• Generate Video (beta) for industry-leading controls that enable creative professionals to generate videos, b-roll, animations and more, all powered by the Firefly Video Model. With Text to Video and Image to Video features, creative professionals can produce stunning high-quality 1080p video from simple text prompts, generate b-roll to fill gaps in timelines, add atmospheric elements to a shot and develop custom motion design elements. Intuitive controls provide new levels of precision to fine-tune any video with detailed camera settings, like sweeping aerial views, frame subjects exactly as envisioned, from dramatic close-ups to expansive long shots, and dynamic movement by selecting from multiple motion paths. Creative professionals can also lock in the first and last frames of a shot to preserve visual continuity, keep colors and character details consistent and more.
• The new Firefly app enables multi-modal workflows, bringing together video, image and vector generation in a single application that empowers creators to seamlessly ideate and create. Creative professionals can generate an image and turn it into stunning video, quickly translate audio into several new languages and write a text prompt to create a video clip with exactly the desired style and camera angle all within Firefly. To take their ideas and creations further, Firefly integrates with Adobe Creative Cloud applications including Photoshop, Premiere Pro and Adobe Express.
• Scene to Image (beta) to create professional quality images from 3D sketches and reference shapes. Using a lightweight 3D sketching tool, creative professionals can transform artwork into beautiful high-resolution images, build structure references directly within Text to Image and create precise visual guides using intuitive 3D tools. Creative professionals can change 3D image angles and perspectives to get the perfect output. With Scene to Image, creators can seamlessly render production-ready assets from 3D shapes, all with the flexibility and precision required in professional graphic design workflows.
• Translate Audio and Video for the translation of spoken dialog into multiple languages while maintaining an authentic voice. Creators can quickly and easily translate videos and audio files to reach a large, global audience with personalized, natural-looking content. With voice, tone, cadence and acoustic match when translating video content into different languages, creators can also spend less time on dubbing performance and audio mixing, saving time and budget on translation and dubbing services. Translate Audio and Video supports translations in over 20 languages.

Available with early access pricing, two new Adobe Firefly plan offerings — Firefly Standard and Firefly Pro — give creators unlimited access to Firefly imaging and vector features as well as tiered capacity for new video and audio features. Firefly Standard plans enable access to 2,000 video/audio credits per month, up to 20 five-second 1080p video generations, starting at US $9.99. Firefly Pro plans enable access to 7,000 video/audio credits per month, up to 70 five-second 1080p video generations, starting at US$ 29.99.

Additionally, a new Firefly Premium plan designed for professionals looking to generate video content on a regular basis will be coming soon to provide even more audio and video capacity for high-volume creators and teams.